Mixed reality head mounted display device

ABSTRACT

Disclosed are a Head mounted Display (HMD) device for use in mixed reality applications such as virtual or augmented reality. The disclosed HMD includes improvement to comfort and convenience of wearing. Convenience features include shifting portions of the HMD&#39;s heat generating and heavier components off the user&#39;s head and on to their neck, or neck and shoulders. Shifting components to the user&#39;s neck opens additional input schemes and enables the use of further feedback devices that improve the immersiveness of the mixed reality experience. An additional convenience feature is an adjustable visor that lifts up and down such that the user may view the real-world or the virtual-world without having to remove the HMD fully from their heads.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation of U.S. patent application Ser. No.15/628,560, filed Jun. 20, 2017, which application is incorporated byreference herein in its entirety.

TECHNICAL FIELD

This disclosure relates to head mounted display devices and moreparticularly to the physical structure thereof.

BACKGROUND

Virtual reality (VR) and augmented reality (AR) visualization systemsare starting to enter the mainstream consumer electronics marketplace.These devices are often bulky and limit the ability of the user to movecomfortably or see.

BRIEF DESCRIPTION OF THE DRAWINGS

One or more embodiments of the present disclosure are illustrated by wayof example and not limitation in the figures of the accompanyingdrawings, in which like references indicate similar elements.

FIG. 1 illustrates an example of an environment including an HMD device.

FIG. 2 illustrates a first embodiment of a hybrid, face and neck displaydevice.

FIG. 3 illustrates a second embodiment of a hybrid, face and neckdisplay device.

FIG. 4A illustrates a hybrid HMD device in a necklace configuration.

FIG. 4B illustrates a hybrid HMD device in a necklace and pendantconfiguration.

FIG. 4C illustrates a hybrid HMD device in a mantle configuration.

FIG. 5 is a block diagram including a first embodiment of componentpositioning in a hybrid HMD.

FIG. 6 is a block diagram including a second embodiment of componentpositioning in a hybrid HMD.

FIG. 7 illustrates an adjustable near-eye display visor in a number ofconfigurations.

FIG. 8 illustrates a hinge mechanism for an adjustable near-eye displaydevice.

FIG. 9 is a block diagram illustrating a close up of an electricalconnection within the hinge mechanism.

FIG. 10 is a flowchart illustrating a method for communicating between aface-mounted unit and a neck mounted-unit.

DETAILED DESCRIPTION

In this description, references to “an embodiment,” “one embodiment” orthe like, mean that the particular feature, function, structure orcharacteristic being described is included in at least one embodiment ofthe technique introduced here. Occurrences of such phrases in thisspecification do not necessarily all refer to the same embodiment. Onthe other hand, the embodiments referred to also are not necessarilymutually exclusive.

Head mounted displays (HMD) are often used for virtual reality oraugmented reality applications, often inclusively referred to as mixedreality. An engineering concern HMDs is often the ease of wearing. HMD'smay be physically and visually restrictive, heavy, awkward, bulky hot,and disorienting. The present disclosure includes improvements uponthese issues.

One way to improve upon mobility and comfort is to remove componentsfrom the user's head. This is sometimes done with backpacks orconnections to external computers. However, these methods make it moredifficult to market, sell all-in-one HMD devices, and cause the user tobe tethered to external devices. The primary issue is removing weight,bulk, and heat from the user's head or face area. To achieve that, it isunnecessary to go so far as placing it on their back. Instead, thecomponents that do not necessarily need to be on the user's face may bemoved to their neck, and worn as a necklace.

Another issue is visibility. This issue is more particularly noticeablein immersive virtual reality applications. Current designs must be takenall the way off in order for a user to see the real world again. Thushaving a display that can be adjusted to either be in front of theuser's face (in use) or propped up on their forehead as if the HMD werea pair of glasses enables the user to view the real world again withouthaving to concern themselves with tightness settings.

FIG. 1 shows an example of an environment including a HMD device 1 thatcan implement the techniques introduced here. In the illustratedexample, the HMD device 10 is configured to communicate data to and froma processing system 12 through a connection 14, which can be a wiredconnection, a wireless connection, or a combination thereof. In some usecases, the HMD device 10 may operate as a standalone device with anintegrated processing system 12. In some use cases, the processingsystem 12 is external to the HMD 10.

The connection 14 can be configured to carry any kind of data, such asimage data (e.g., still images and/or full-motion video, including 2Dand 3D images), audio data (including voice), multimedia, and/or anyother type(s) of data. The processing device 12 may be, for example, agame console, personal computer, tablet computer, smartphone, or othertype of processing device. The connection 14 can be, for example, auniversal serial bus (USB) connection, Wi-Fi connection, Bluetooth orBluetooth Low Energy (BLE) connection, Ethernet connection, cableconnection, DSL connection, cellular connection (e.g., 3G, LTE/4G or5G), or the like, or a combination thereof. Additionally, the processingdevice 12 may communicate with one or more other processing systems 5via a network 4, which may be or include, for example, a local areanetwork (LAN), a wide area network (WAN), an intranet, a metropolitanarea network (MAN), the global Internet, or a combination thereof.

The processing system 12 may further connect to a network 16, such asthe Internet, a local area network (LAN), or a virtual private network(VPN). Through the network 16, the HMD device 10 may make use of asecondary processing systems 18.

FIG. 2 illustrates a first embodiment of a hybrid, face and neck displaydevice 20 (hybrid device). The hybrid device has a face-mounted unit 22and a neck-mounted unit 24. The face-mounted unit 22 includes componentsthat are sensory and control related (e.g., display, motion sensors,etc. . . . ). Conversely, the neck-mounted unit 24 includes the bulkiestcomponents (e.g., the batteries). Some components are neitherbulky/heavy but are also not relevant to sensory and controls (e.g.,processors such as the CPU/GPU). These components may be places ineither unit 22, 24 or both. In some embodiments, components not relatedto sensory or control apparatus are positioned in the neck-mounted unit24.

The hybrid device 20 includes some additional enabling components. Onesuch enabling component is a means for mounting the face-mounted unit 22to the user's head/face. Such means is displayed in FIG. 2 via straps26. Other than straps 26, the means for mounting may include a headband,a halo, clamps/clips, or a hat/helmet. The face and neck mounted units22, 24 are communicatively connected to one another. This connection maybe either wired or wireless. In FIG. 2, the connection is a cable 28.The cable carries both power and data between the units 22, 24.

The neck-mounted unit 24 in FIG. 2 is in a necklace configurationincluding a pendant 30. The necklace configuration may be wrapped, slid,or clamped around the user's neck. FIG. 2 also includes a face-unitmounted camera 32. The face-mounted unit 22 may include a number ofsensors.

An advantage of the displayed embodiment is that the face-mounted unitis lighter and thus will fit more comfortably on the user's face. Thisenables the user to be more mobile during use. The neck-mounted unit 24is significantly lighter than a backpack, but still enables weight to beremoved from the face-mounted unit 22. Additionally, a more robustcooling system may be employed on the neck-mounted unit 24 than wouldotherwise be comfortable on a face-mounted unit 22. Vibrations createdby a fan are more noticeable and irritating as felt through the skullthan on the clavicle. Vibrations received through the skull are oftenaudible (e.g., music played through a metal rod that is clenched in theteeth can be heard). Conversely, a user cannot hear weak vibrationsthrough the clavicle.

FIG. 3 illustrates a second embodiment of a hybrid, face and neckdisplay device 20A. The figure is similar to the embodiment displayed inFIG. 2. Displayed is an alternate embodiment 20A of the means ofmounting the face-mounted unit 22.

The “4” Figure series illustrates a number of embodiments for theneck-mounted unit 24.

FIG. 4A illustrates a hybrid HMD device in a necklace configuration 34.The necklace configuration 34 wraps around the user's neck much like anecklace. In some embodiments, the necklace configuration 34 completelyencircles the user's neck, once clasped. In other embodiments, thenecklace configuration wraps partially around the user's neck. There area number of ways of securing the necklace configuration 34 on the userincluding clasps, force fit, magnets, a hinge, or other methods known inadorning neck mounted wearables.

The necklace configuration 34 may position components within a hollowvolume of the neck-mounted unit. The exact positioning of each componentwithin the hollow volume may vary. In some embodiments, the componentswithin the hollow volume are positioned to balance weight across theentire neck-mounted unit.

FIG. 4B illustrates a hybrid HMD device in a necklace and pendantconfiguration. The neck-mounted unit 24 is shown with a necklaceconfiguration 34 and a pendant 30. The pendant 30 is primarily used forcomponent storage. In this configuration the bulk of the weight of theneck mounted unit 24 is within the pendant 30. The pendant 30 may beconstructed a number of ways including a fixed position in front of theuser, a dangling position from the necklace 34 (including wiredcommunication there between), multiple pendants, or other methods knownin the art of adorning worn articles around the neck.

The pendant itself does not necessarily have to be positioned on thefront, center of the user's neck. The weight of the components may bedistributed at the back, on the sides, or evenly on either side.

FIG. 4C illustrates a hybrid HMD device in a mantle configuration 36.The mantle configuration 36 is notably more robust than either thenecklace configuration 34, or the necklace and pendant configuration 30.The mantle configuration 36 expands across, and derives support from thewearer's shoulders. Use of a mantle shaped adornment provide the digitalspace in a hollow volume in which to position components, while stillretaining a smaller profile that a backpack.

While other configurations may include the same additional components,the mantle configuration 36 is more readily configured for hapticfeedback, jets of air or water used for improving an immersiveexperience, and speakers including bass tones or subwoofers. While itmight not be preferable to feel vibration from a fan on one's skull(thereby “hearing” the fan), experiencing the pulsing of a subwoofer onone's shoulders can improve an immersive experience. The additionalimmersive experience components may be positioned on one or bothshoulders of the mantle configuration 36.

FIG. 5 is a block diagram including a first embodiment of componentpositioning in a hybrid HMD 20 between the face-mounted unit 22 and theneck-mounted unit 24. The overall scheme in component positioning, withsome exceptions, is to remove all components that do not need to be onthe user's face, from the user's face. One of the primary components inan HMD is the display 38. The display 38, in operation, needs to be infront of the user's eyes, and therefore must remain on the face-mountedunit 22. In some embodiments, the display 38 is a portion of the mobiledevice such as a cell phone or tablet. In such embodiments, theface-mounted unit 22 comprises a housing where the mobile device may beinserted into the housing during use. Additionally, the face-mountedunit 22 may include a suite of sensors. The face-mounted unit 22 usesthe sensors to either accept input or render output for user.

Sensors in the sensor suite include a binocular optical module 40, afront facing camera 42, the proximity sensor 44, an eye-gaze sensor 46,and inertial measurement unit (IMU) 48 or accelerometer, a microphone50, a radar sensor 52, a LIDAR sensor 54, speakers 56, or other sensoryequipment known in the art. The binocular optical module 40 refers to aset of lenses that adapt a display to be suited for view separately ineach of two eyes, and very close up.

While these components may be used for multiple purposes, componentssuch as the display 38, the binocular optical module 40, and thespeakers 56 provide output to the user. Components such as the camera42, the proximity sensor 44, the radar 52, or the LIDAR 54 are used toprovide input to the HMD 20 that is environmentally based (i.e., notdirectly provided by the user). While these environmentally based inputsensors may also be positioned on the neck-mounted unit 24, positioningthe sensors on the user's face enable them to capture the environmentwithin the line of sight of the user despite the orientation of theuser's body.

Finally, components such as the eye-gaze sensor 46, the IMU 48, and themicrophone 50 each collect direct user input. The eye gaze sensor 46must be positioned on the face-mounted unit 22 and within proximity ofthe user's eyes in order to detect where the user's eyes are looking onthe display. The microphone 50 may be positioned on the neck-mountedunit 24; however, placing the microphone closer to the user's mouth(i.e., their face) improves microphone performance.

The IMU 48 is positioned on the face-mounted unit 22 in order to detectthe motion of the user's head. One advantage of moving heavy componentsfrom the user's face to their neck is that movement of the user's headwill feel more natural. Detecting the movement of the user's head isimportant element in maintaining an immersive experience. The neckmounted unit 24 may also include IMU 48. Such inclusion of an additionalIMU 48 enables mixed reality programs to isolate input types. Forexample, a first IMU 48 on the user's face detects orientation andpositioning of the user's head, a second IMU 48 on the user's neckdetects motion of the body.

The distinction between the two input types corresponds to inputprovided in many known controller based video games—one control to movea player's character (commonly left control stick or WASD keys), and asecond control to direct the player character's point of view (commonlyright control stick or mouse cursor). Isolating user input into morethan one type and from multiple positions may provide increasedperformance. For example, if a user whips their head forward veryquickly, the HMD 20 will not interpret this as forward motion, becausethe neck-mounted IMU 48 did not move.

In some embodiments, the IMU 48 includes matching components in both theface-mounted unit 22 and the neck-mounted unit 24 that make use ofmagnetic fields to determine their relation in positioning to oneanother. This provides high-performance detection for user hadpositioning and orientation.

The neck-mounted unit 24 includes the remaining components necessary tooperate the HMD 20. Notably, these components include a battery 58 insome form of controller or processing unit. The controller may include aCPU 60, and/or a GPU 62. In some embodiments, processing features arenot moved to the neck-mounted unit 24. Processors such as the CPU 60 andthe GPU 62 may be built with a very small profile and do not weigh verymuch. Accordingly, the processing components may be placed in theface-mounted unit 22 or an additional unit, such as one positioned atthe back of the user's head.

A number of other components may optionally be positioned in theneck-mounted unit 24. Such components include memory or storage space64, a cooling system (fan) 66, a haptic feedback system 68, thesimulated weather system (air jets/water jets) 70, speakers/subwoofers72, a wireless transceiver (Bluetooth, Wi-Fi, near field communication,etc.), or other suitable devices known in the art. Components such asthe battery 58 or processing cores 60, 62 often generate a lot of heat.In addition to management of the weight of the HMD 20 heat managementposes limitations for the processing power of the HMD 20. The ability toinclude a fan 66 can improve the overall processing power of the HMD 20.

Haptic feedback systems are often not implemented on head mounteddevices for comfort reasons. Placement of the haptic feedback system 68on the neck-mounted unit 24 increases functionality without increasinguser discomfort. Similarly, including simulated weather/environmentsystems 70, such as air jets or water jets, on a face-mounted device isdifficult. This is due to the difficulty in obtaining a good angle atwhich to shoot the jet at the user. When mounted on the neck, the HMD 20has more ability to angle the jets in usable ways. Air or fluid jets mayhave additional uses beyond replicating micro-weather. For example, theweather/environment system 70 may also create the sense of motion orscent. Perfumes or scented sprays may be emitted from the environmentsystem 70. Further air jets can simulate the sensation of not only themovement or air, but the user's movement through the air (e.g., as if ona virtual motorcycle).

Similarly, subwoofers 72 or other larger speakers that are oftendifficult to include on a compact, face mounted device. The neck-mountedunit provides more surface area and an internal volume (to resonatesound waves) which in turn makes the use of subwoofers more feasible.

Wireless communication is also a relevant portion of modern computingand gaming. Thus, the inclusion of a wireless transceiver 74 in HMDs isbeneficial. As the wireless communicator does not necessarily have to bemounted on the face of the user, optional placement on the neck reducesface-mounted components. The wireless transceiver 74 enables the HMD 20to communicate with external networks and the Internet or additionalperipherals, such as handheld controllers.

FIG. 6 is a block diagram including a second embodiment of componentpositioning in a hybrid HMD 20. FIG. 6 is similar to FIG. 5 with theaddition of wireless communicators in both the face-mounted unit 22 inthe neck-mounted unit 24. In some embodiments, communication betweenboth units 22, 24 is wireless rather than wired. Wireless communicationmay include data, power, or both. In order to facilitate wirelesscommunication, the wireless transceiver 74 of the neck-mounted unit 24transmits signals to and from a face mounted wireless transceiver 76.Where power is not transferred, the face-mounted unit 22 additionallyrequires a face mounted battery 78 to operate.

The HMD 20 may additionally communicate with outside peripherals, suchas a controller 80. Communication with the controller 80 may be wired orwireless.

FIG. 7 illustrates an adjustable near-eye display visor in a number ofconfigurations. An additional issue in HMD wearability is the abilityfor the user to return to the real-world conveniently. HMDs generallyhave a snug fit on the user's head. In some circumstances itinconvenient to take off the HMD entirely. Rather is preferable for theuser to briefly be able to view the real-world again before returning toan immersive VR experience.

The adjustable HMD 82 includes an adjustable visor 84 attached to a headmount 86 via a hinge 88. The adjustable visor 84 includes the near-eyedisplay of the HMD device. In use, the adjustable visor 84 is positionedin front of the user's eyes. When the user wishes to view the real-worldagain without taking the adjustable HMD 82 off, the user lifts theadjustable visor 84 to a raised position on their head and locks thevisor in position via the hinge 88. The head mount 86 wraps fully aroundthe user's head such that the visor 84 is not required to stabilize theadjustable HMD 82. The features of the adjustable HMD 82 may be usedwith the features of the hybrid HMD 20 such that an adjustable visor 84is included in the same HMD as a neck-mounted unit 24.

FIG. 8 illustrates a hinge mechanism for an adjustable near-eye displaydevice. FIG. 8 includes the same adjustable HMD 82 is the views of FIG.7, though with increased focus on the hinge 88. Further illustrated area number of the sensory suite components of the face-mounted unit 22 ofthe hybrid HMD 20 such as the front facing camera 42 and speakers 56.

FIG. 9 is a block diagram illustrating a close up of an electricalconnection within the hinge mechanism 88. In some embodiments, HMDcomponents are located external to the visor 84. In order to accommodatethose components with a wired connection there needs to be electricalconductivity through the hinge 88. There are a number of means oftransmitting on digital signals and power through a hinge.

One such means includes a contact surface 89 between an inner ring 90and outer ring 92 of the hinge 88. Each of the head mount 86 and theadjustable visor 84 is associated with one of either the inner ring orthe outer ring 90, 92. Wiring connects each of the respective portionsof the adjustable HMD 82 to the rings 90, 92. The contact surface 89provides the necessary electrical connection there between.

An alternative means is to make use of the central area 94 of the hinge88. In some embodiments, a wire merely runs through the central area 94.Alternatively, each side of the central area 94, respectively one sidefor the adjustable visor 84 and one side for the head mount 86, includesa contact surface.

FIG. 10 is a flowchart illustrating a method for communicating between aface-mounted unit and a neck mounted-unit. When both a face-mounted unitand a neck-mounted unit are used, communication between the two isnecessary. The connection between the two may be wired or wireless, andmay pass either data, power, or both data and power. Additionally, ifonly one of the units includes a power source, power must be sharedbetween the units. In step 1002, the HMD Displays a mixed realityexperience on a near-eye display mounted on a head of a user to theuser. In step 1004, a neck-mounted unit transmits power and electricalsignals to the near-eye display via a connection, wherein theneck-mounted unit includes a battery and a processor.

Although the subject matter has been described in language specific tostructural features and/or acts, it is to be understood that the subjectmatter defined in the appended claims is not necessarily limited to thespecific features or acts described above. Rather, the specific featuresand acts described above are disclosed as examples of implementing theclaims and other equivalent features and acts are intended to be withinthe scope of the claims.

The invention claimed is:
 1. A head mounted display (HMD), comprising: ahead mount that encircles a head of a user that secures the HMD to thehead; a near-eye display; and a hinge mechanically connecting thenear-eye display to the means for securing, the hinge configured toenable the near-eye display to have a first position and a secondposition, wherein the first position is over eyes of the user and thesecond position is over a forehead or a frontal scalp region of theuser, the hinge including a first contact surface associated with thehead mount and a second contact surface associated with the near-eyedisplay that form an electrical connection configured to carryelectrical signals or electrical power between the near-eye display andthe head mount, the first contact surface and second contact surfacepositioned on concentric wheels that are configured to fix a positionrelative to one another.
 2. The HMD of claim 1, wherein the near-eyedisplay is constructed so as to not contact the head of the user when inthe first position.
 3. The HMD of claim 1, wherein the near-eye displayis constructed so as to not contact the head of the user when in thesecond position.
 4. The HMD of claim 3, wherein the near-eye display isconstructed in an arc shape.
 5. The HMD of claim 1, wherein the near-eyedisplay comprises: a mobile device; and a housing configured to securethe mobile device in a single position.
 6. The HMD of claim 1, furthercomprising: an auxiliary module including processing or electrical powerthat is communicatively coupled with the near-eye display via theelectrical connection by way of the head mount.
 7. The HMD of claim 6,wherein the auxiliary module is neck-mounted.
 8. The HMD of claim 1, thenear-eye display further comprising any of: a binocular optical module;a camera sensor; an inertial measurement sensor; a microphone; a radarsensor; a LIDAR sensor; a proximity sensor; an eye gaze sensor; orspeakers.
 9. A head mounted display (HMD), comprising: a head bandconfigured to encircle a head of a user and mount the HMD to the user;and an adjustable display unit that mechanically connected to the headband via a hinge including a first contact surface associated with thehead band and a second contact surface associated with the adjustabledisplay unit, the first contact surface and second contact surface areconfigured to carry electrical signals or electrical power between theadjustable display unit and the head band, the first contact surface andsecond contact surface positioned on concentric wheels that areconfigured to fix a position of the adjustable display unit in: a firstposition over eyes of the user; and a second position over a forehead ora frontal scalp region of the user.
 10. The HMD of claim 9, wherein theadjustable display unit comprises of: a mobile device; and a housingconfigured to secure the mobile device in a single position.
 11. The HMDof claim 9, further comprising: an auxiliary module including processingor electrical power that is communicatively coupled with the adjustabledisplay unit via the physical electrical connection by way of theheadband.
 12. The HMD of claim 11, wherein the auxiliary module isneck-mounted.
 13. The HMD of claim 9, the adjustable display unitfurther comprising any of: a binocular optical module; a camera sensor;an inertial measurement sensor; a microphone; a radar sensor; a LIDARsensor; a proximity sensor; an eye gaze sensor; or speakers.
 14. A headmounted display (HMD), comprising: a head band configured to encircle ahead of a user and mount the HMD to the user; an adjustable housing unitthat is configured to receive and secure a mobile device including adisplay screen, the adjustable housing unit mechanically connected tothe head band via a hinge including a first contact surface associatedwith the head band and a second contact surface associated with theadjustable housing unit, the first contact surface and second contactsurface configured to carry electrical signals or electrical powerbetween the adjustable housing unit and the head band, the first contactsurface and second contact surface positioned on concentric wheels thatare configured to fix a position of the adjustable housing unit to: afirst position over eyes of the user wherein when received, the displayscreen of the mobile device faces the eyes of the user; and a secondposition over a forehead or a frontal scalp region of the user whereinwhen received, the display screen of the mobile device is substantiallyremoved from view of the user.
 15. The HMD of claim 14, wherein theadjustable housing unit is constructed so as to not contact the head ofthe user when in the first position.
 16. The HMD of claim 14, whereinthe adjustable housing unit is constructed so as to not contact the headof the user when in the second position.
 17. The HMD of claim 16,wherein the adjustable housing unit is constructed in an arc shape. 18.The HMD of claim 16, further comprising: a peripheral control device.